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Abstract 

We examine classical, transient fluctuation theorems within the unifying framework of Langevin 
dynamics. We explicitly distinguish between the effects of non-conservative forces that violate de- 
tailed balance, and non-autonomous dynamics arising from the variation of an external parameter. 
When both these sources of nonequilibrium behavior are present, there naturally arise two distinct 
fluctuation theorems. 
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I. INTRODUCTION 



The fluctuation theorem refers to a set of exact relations describing the statistical me- 
chanics of systems away from equilibrium, generically expressed by the formula, 



(1) 



Here is the distribution of observed values of a quantity representing dissipation or 
entropy production. The fluctuation theorem was originally formulated for non- conservative 
forces but autonomous dynamics , such SIS db fluid subject to constant shear, 

or a charged particle pushed through a thermal environment by a constant external field. 



Related results have also been derived for the case of non-autonomous dynamics 
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12l 3,0]; i n which the system of interest is driven away from a stationary state by 



the external forcing of a work parameter, as when a piston is pushed into a gas of particles. 



For further extensions and unifying frameworks see Refs 



for reviews, see Refs. 
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In the current paper we present an exposition of transient fluctuation theorems within 
the path-integral formalism of Langevin dynamics. We consider two distinct mechanisms 
for achieving nonequilibrium behavior: non-conservative forces (explicit violation of detailed 
balance), and non-autonomous dynamics (external forcing), and we distinguish the contri- 
butions that each of these factors makes to the fluctuation theorem. We will show that when 
both mechanisms are present, the definition of S is not unique, and there arise two distinct 
fluctuation theorems. 

In the following two Sections, we specify the general class of Langevin dynamics we 
consider in this paper, first using the Fokker-Planck formalism (Sectioning, then in the path- 
integral representation (Section ILTT|). In Section HYI we derive a fluctuation theorem, Eq. H21 
by comparing the evolution of our system during a forward process (as an external parameter 
is varied from an initial value A to a final value B) to its evolution during the corresponding 
reverse process (B — > A). In Section|Swe obtain a different fluctuation theorem, Eq. OH! by 
considering the effect of reversing not only the protocol for varying the external parameter, 
but also the underlying dynamics. In Section EH we discuss physical interpretations of the 
quantities appearing in our results, and in Section IVHI we illustrate these results using a 
simple model system with two degrees of freedom. Finally, in Section IVIIII we discuss the 
integrated fluctuation theorems that follow immediately from Eqs. 031 and |^ we present an 



alternative derivation of these integrated results, which in turn leads to an extension of the 
fluctuation theorems derived in Sections |IV| and El 



II. STOCHASTIC MODELING AND DEFINITIONS 

Consider an overdamped classical system described by the stochastic differential equation, 

j t Xi = F i (x;X)+Ut;x;X), (2) 

where Xj, with i = 1, • • ■ ,N, denote a set of dynamical variables, and A represents an 
externally controlled parameter. F represents the deterministic component of the dynamics; 
the stochastic component £ is a 5-correlated noise field, whose mean is zero and whose pair 
correlation function is: 



£(t)£lV)) = Gii8(t-lf), (3) 

where G(x; A) is a symmetric, positive definite matrix. Eq. El can be viewed as the A — > 
limit of a Markov process with discrete time steps tk+i — tk = A. In the Appendix, we 
specify this limiting procedure, and show that an ensemble of systems governed by Eq. El is 
described by a probability density p(x,t), evolving under the Fokker-Planck equation 

^ = -d\F t p) + i# [G^p)] = C x p. (4) 

Summation over repeated indices is implied. As the notation indicates, the Fokker-Planck 
operator C\ depends explicitly on the parameter A. Throughout this paper we will assume 
that when A is held fixed, p relaxes exponentially to a unique stationary distribution 

p s {x; A) = exp [-(p(x; A)] , (5) 

hence 

C x exp[-(f(x;X)] = (6) 

and all other eigenvalues of C\ are negative and bounded away from zero. 

For fixed A, the dynamics are specified by the vector field F and the matrix field G. Now 
let T(x; A) denote the matrix inverse of G(x; A), i.e. T^Gjk = S l k , and consider two vector 
fields, v(x; A) and A(x; A): 

v* = 2V ij Fj (7) 
A i = v' + tfcp . (8) 



These will play an important role in the following analysis. In terms of v, Eq. 0] becomes 

Gij(v j - d j )p\ =-&Ji, (9) 



dt 2 



where J(x,t) = (l/2)G(v — V)jo is the current density. Substituting p = p s = e v , we get 
the stationary current density j27|: 



J?{x ] \) = ±G ij Aie-* 



e^. (10) 



This current is divergenceless: 

&j? = o. (ii) 

If v can be written as the gradient of a scalar field, v(x; A) = — V£7(cc;A), then the 
stationary state is oc e~ u , as seen by inspection of Eq. It then follows from Eq. |H] 
that A = 0, which in turn implies a vanishing stationary current, J s = (Eq. ITUjl . In 
this situation we say that the forces acting on the system are conservative, or equivalently 
that detailed balance is satisfied, and we interpret p s oc e~ u as an equilibrium (canonical) 
distribution. By contrast, if v ^ — V£7, then the forces are non- conservative, detailed 
balance is violated, and A, J s ^ 0. We will thus view A as an indicator that distinguishes 
between conservative (A = 0) and non-conservative (A ^ 0) forces. 

Another important distinction is that between autonomous and non- autonomous dynam- 
ics. The former refers to the situation in which we observe the evolution of the system 
with A held fixed, while the latter denotes the case when the parameter is varied externally 
according to some schedule A*. 

Throughout this paper we will consider processes during which the system evolves over a 
time interval — r < t < +r, and we will generally assume that initial conditions are sampled 
from the stationary state: 

p(x,-T)=exp[-(p{x;\- T )]. (12) 

(See however the end of Section EU as well as Refs. [3,13 f° r discussions of more general 
initial conditions.) If the forces are conservative and the dynamics autonomous, then the 
system remains in equilibrium over the interval of observation: p(x, t) oc exp [—U(x; Agxed)]- 
However, if we have either non-conservative forces or non-autonomous dynamics, or both, 
then we achieve nonequilibrium behavior, for which fluctuation theorems can be derived. 
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Finally, rearranging Eq. E3to express F as a function of G, ip, and J s , we can rewrite 
the Fokker-Planck operator explicitly in terms of the stationary density and current: 

£ xP = -d l ( Jf e>) - l -d l [G ije -^ (e>)] . (13) 

By considering various choices of (divergenceless) J s , while keeping G and y fixed, we 
explore a family of stochastic dynamics with a common stationary density but different 
stationary currents. If £\ corresponds to a given choice of {J s ,(p, G}, then we will use 
the notation £\ to denote the Fokker-Planck operator corresponding to {—J s ,(p,G}. By 
Eq. HOI the deterministic component of the dynamics associated with £\ is given by 

Fi = -Ft - Gy&tp. (14) 

Using the path-integral formalism discussed in the following Sections (Eq. |3H] in particular) 
it is straightforward to establish that 

P x (x', At\x) p s (x) = P x (x, At\x') p s (x) (15) 

for any At > 0, where P\ and Pa are transition probabilities associated with the dynamics 
generated by £\ and £\, respectively. Recognizing each side as a joint probability for 
observing a pair of events (separated by a time interval At) in the stationary state, Eq. 
is interpreted as follows: if we generate an infinitely long trajectory using the dynamics 
£\, and we then replace this trajectory by its time-reversed image, x t — > x_ t , then the 
new trajectory will be statistically indistinguishable from a trajectory generated by £\. In 
particular the two trajectories will be characterized by the same stationary density, p s , but 
opposite currents, ± J s . When two stochastic dynamics are related by Eq. HSJ we say that 
the one is the reversal Q, or the p^-dual Q, of the other. This natural pairing of Fokker- 
Planck operators (C\, C\) will play an important role in Section |V[ where the analysis is 
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very similar to that carried out by Crooks for discrete-time Markov processes 
that £\ = £\ when J s = 0; in this case Eq. is just the familiar statement of detailed 
balance associated with conservative forces. 

As a simple illustrative model, shown in Fig. ^ consider a particle in two dimensions, 
r = (x, y), with 

F(r;\) = --q + -f(q)e , G^r; A) = - (16) 

7 7 7 



FIG. 1: Depiction of the illustrative model described in the text. The point r is the location of 
a Brownian particle inside a harmonic well, kq 2 /2, centered at r\. The grey arrow represents the 
angular drift force f(q)9, also centered at r\. 

Here q = r — r\ is the displacement of the particle relative to a point r\ = (A, 0); and the 
unit vector 6 is normal (oriented 90° counterclockwise) to the unit vector q = q/q. When 
/ = 0, Eq. describes a Brownian particle in a harmonic well centered at r\, with spring 
constant k > 0, friction coefficient 7 > 0, and temperature ksT = 1. When f(q) is positive 
(negative), this particle experiences an additional counter-clockwise (clockwise) drift around 
the point r A . For this model, we have: |30( 

p s cxe-^/ 2 , A = f(q)6 , J s = -f{q)0e-*. (17) 

7 

Thus the stationary state is characterized by a Gaussian distribution, p s , and an average 
angular drift around the point r\. If £\ denotes the Fokker-Planck operator for a given 
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choice of k, 7, and f(q), then L\ is obtained by reversing the direction of the angular drift: 



C x ^{k n ,+f(q)} 



(18) 



We will use this model in Section IV11I to illustrate the central results of this paper. 



III. PATH INTEGRAL FORMALISM 



The main theoretical tool that we will use in this paper is the path-integral representation 
of Langevin dynamics 31, 0]. Let X = {x t }t^ denote a trajectory that specifies the 
evolution of the system from — r to +r. When A is held fixed, the conditional probability 
of observing this trajectory, given the initial microstate £E_ r , is: 



V x [X\x_ T ] = Afexp 



dtS + (x t ,x t ; A) 



S + (x,x;X) = ^(xi-F^ixi-F^ + ^Fi. 



(19) 
(20) 



As discussed in the Appendix, the continuous-time integral in Eq. HH1 is interpreted as the 
limit of a discrete sum, using mid-point (Stratonovich) discretization. 

Imagine that the system evolves as A is varied externally from an initial value A^ T = A 
to a final value A+ T = B, according to a schedule, or protocol, Af . We refer to this as the 
forward process, indicated by the superscript F. During this process, the system satisfies 



j^Xi = Fi(x; Af) + £i(t; x; Af ). 



(21) 



The conditional probability of observing a trajectory X is obtained by a straightforward 
generalization of Eq. 



V F [X\x- T ] = Afexp 



/+T 
dtS+(x t ,x t ; A 



(22) 



If we sample x_ T from the stationary distribution p s (x; A) (Eq. [T2*|) . the net (unconditional) 
probability of observing the trajectory X is: 



V F [X]=p s A (x_ T )V F [X\x_ T ] 



(23) 



where p s A (x_ T ) = p s (x_ T ; A). 



7 



Along with the forward process, we will consider a reverse process, during which the 
parameter is manipulated from B to A. Specifically, during the reverse process we have 

d 



dt 



Xi = Fi(x; Xf ) + &(t; x; Xf 



t ii 



where 



A? = A 



(24) 



(25) 



The conditional and unconditional probabilities of observing a trajectory X during this 
process are given by the analogues of Eq. 1221 and | 



V R [X\x_ T ] = Afexp 



dt S+(x t , x t ; Xf^ 



V R [X] = p s B (x-r)V R [X\x_ T ] 



(26) 
(27) 



Here we have assumed the same underlying stochastic dynamics - that is, the same family 
of Fokker-Planck operators £\ - for the reverse process as for the forward process; the only 
distinction between the two processes is the protocol for varying A. 



IV. FLUCTUATION THEOREM FOR REVERSED PROTOCOL 



Now let X^ = {a?}}^ denote the time-reversed "conjugate twin" of a trajectory X: 

x\ = x- t , (28) 

and let us compare the probability of observing a trajectory X during the forward process, 
with that of its twin X^ during the reverse process. Using Eqs. 1251 l2*o1 and |2*HI we get 



Xi\xLr] =Afexp 



dtS + (x\,xl;X^ 



AAexp 



dtS-(x t ,x t \ Af) 



where 

S-(x, x; A) = S + (x, —x; A). 
The definitions of v, A, and S± then give us 

S + — S- = —XjV j = ij (cPtp — A j ) 

which combines with Eqs. 1221 an d EH1 to yield 

V F [X\x. T ] 
V R [X^\xl T ] 



exp I / dtijV 3 



(29) 
(30) 

(31) 
(32) 
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where J F denotes evaluation along the forward protocol and trajectory X. When the dif- 
fusion tensor is a constant, G(x; A) = 2D5ij, this ratio is equivalent to a result derived 
previously by Seifert ( Eg . 14 of Ref. [3]), and extended to inertial systems by Imparato and 

From Eq. EH we obtain 



Peliti (Eq. 34 of Ref. 



lj = 1 1 , J = exp Aw + / diijV 3 , 33 



where 



A(p = V (x T ; B) - <p(x_ T ; A) = j dt (\ F ^ + xj d j ^j . (34) 

Let us now rewrite Eq. E21 so that the quantity in the exponent is manifestly a sum of 
contributions representing non-autonomous dynamics and non- conservative forces. Defining 

Y^fdtxf^ (35) 

we obtain 

PF[X] -exp(V F + / dx-A). (36) 



P R [Xt] 

A non-zero value of Y F is a signature of non-autonomous dynamics (Eq. I33|). whereas A/0 
indicates non-conservative forces (Section |TTJ). Thus we associate the two terms, Y F and 
J F dx ■ A, with the two mechanisms for achieving nonequilibrium behavior identified at the 
end of Section |TlJ Let R denote the sum of these two terms: 

R F [X] =Y F + ^ dx-A. (37) 

When the dynamics are autonomous and the forces conservative, both terms are equal to 
zero, hence V[X\ = V[X^]: in equilibrium, any sequence of events is as likely as the reverse 
sequence; see e.g. the discussion following Eq. [13] of Ref. 33^ . 
For the reverse process we similarly define 

Y R = pdtXf^- , R R = Y R + pdx-A. (38) 

The quantities Y and R are odd under time- reversal, in the following sense: 

K R [Xt] = -Y F [X] , R R [X*] = -R F [X}. (39) 

With this formalism in place, we now derive a fluctuation theorem for R = Y + j dx-A. 
Let p F {R) denote the distribution of R values for an ensemble of realizations of the forward 



process, and define p R (-R) analogously for the reverse process. Then 

p F (R) = J VXV F [X}6(R-R F [X}) (40) 

= J VXV R [X^} exp (R F [X}) 5(R- R F [X}) (41) 

= exp(i?) J VX ] V R [X^] 5(R + R R [X^]) , (42) 

where VX = Ylk=o d N Xk specifies an integral over all possible trajectories X (see Appendix). 
We have used Eq. EHlto get from the first line to the second, and Eq. EE] to get to the third. 
Note also the change of variables, T>X — > T>X\ Recognizing the final integral as p R (— R), 
we obtain the desired fluctuation theorem jl8j |: 

^§j = eMR) - (43) 

V. FLUCTUATION THEOREM FOR REVERSED PROTOCOL AND DYNAM- 
ICS 

The evolution of the system is influenced by both the protocol for varying A, and the 
stochastic dynamics that define the Langevin transition rates. In the previous Section we 
assumed that the forward and reverse processes are defined by conjugate protocols but the 
same underlying dynamics (Eqs. |^ I24|) . Thus the reverse process was defined relative to 
the forward process by the replacement 

{£ A ,Af}^{£ A ,A R }. (44) 

In this Section we obtain a different fluctuation theorem by imagining that the reverse 
process is characterized by a reversal of both the protocol and the underyling dynamics. 

Specifically, we imagine that during the forward process the system satisfies Eq. |^ as in 
the previous Section. However, for the reverse process, we take 

j t x i = F i (x;Xf)+Ut;x;Xf), (45) 

where F = —F — GVtp (Eq. IT4*|) . rather than Eq. Thus the reverse process is now 
defined by the replacement 

{£ A ,Af}^{£ A ,A R }. (46) 
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In this situation the conditional probability of a trajectory X during the reverse process is 



V R [X\x- T ] = A/" exp 



+ T 



dtS+(x t ,x t - X] 



(47) 



where S + is defined as its counterpart S + , but with F replaced by F. Let us similarly define 
S-(x, x; A) = S + (x, —x; A) (as in Eq. l3*Uj) . By direct evaluation we obtain 



S + - S- = ±i&<p + e tp d i 



Fi - -Gijd 3 ) < > 



Xid l ip, 



(48) 



since the quantity in square brackets is just the i'th component of the divergenceless sta- 
tionary current (Eq. I10p. 

Repeating the steps of Section IIV1 but with Eq. US] in place of Eq. EH we get 



— i = exp (— [ dt Xjd l (p\ 
] \xl T ] \ J J 



and in turn 

V F [X] 



V R [X 



V F [X \x„ T 
V R [X 



exp I Aip — dt Xid t (f = exp 



(49) 



dtX 



\F 



exp (Y F ) 



(50) 



This is identical to Eq. except that the term J F dx ■ A no longer appears inside the 
exponent on the right side. In effect, by using L\ for the reverse process, Eq. we have 
"gauged away" the non- conservative contribution arising from A (compare Eqs. IHT1and l4*Sj) . 
leaving only the non-autonomous contribution associated with the variation of A. 
Eq. E01 leads to the analogue of Eq. HHJ 

P F (+Y) 



P R (-Y) 



(51) 



where p F is the distribution of Y values for the forward process (C\, Af ), and p R is defined 
similarly for the reverse process (£\, X R ). This is a continuous-time analogue of the fluctua- 
tion theorem obtained by Crooks for discrete-time processes (our Eqs. I4U1 and ISTl correspond 
to Eqs. 13 and 20 of Ref. Q-) 

We thus see that two different fluctuation theorems (Eqs. EH1 l5Tf emerge naturally in the 
Langevin formalism that we have considered. The relationship between these two results 
can be appreciated by separately considering the three different combinations for achieving 
nonequilibrium behavior: 
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• Non-conservative forces, autonomous dynamics (A ^ 0, A = 0). In this case Y = by 
definition, hence Eq. OH] has no meaning. Thus we get a unique fluctuation theorem, 
Eq. 1121 for a quantity R = f dx ■ A associated with the violation of detailed balance. 

• Conservative forces, non- autonomous dynamics (A = 0, A ^ 0). In this case C\ = £\ 
and Y = R. Thus Eq. H21 is equivalent to Eq. so we again obtain a unique 
fluctuation theorem, this time for the quantity Y = R = f dtXdip/dX associated with 
external forcing. 

• Non-conservative forces, non- autonomous dynamics (A ^ 0, A ^ 0). Eqs. El3l and I5T1 
now represent two different, but equally valid, fluctuation theorems, for the distinct 
quantities Y — f dt A dtp/dX and R = Y + f dx ■ A. 



VI. PHYSICAL INTERPRETATIONS 



To this point our analysis has been mostly abstract and mathematical. For the Langevin 
process defined by Eq. we have derived two fluctuation theorems, and in Section IVIIII 
below, closely related integrated fluctuation theorems are obtained. In the present Section 
we briefly discuss physical interpretations of the quantities appearing in these results. 

Eq.|2]can be used to model the microscopic evolution of a system in contact with a thermal 
reservoir at temperature T, in the overdamped limit, with A playing the role of an externally 
manipulated work parameter. The stationary state is then given by the Boltzmann-Gibbs 
distribution p s = e^ - ^, with (3 = (fc^T) -1 , hence 

(p(x;\) = l3U(x;\)-PF(\), (52) 

where U(x; A) represents the internal energy of the system, and F(X) is the parameter- 
dependent free energy. (We leave implicit the temperature dependence of F.) We generi- 
cally expect detailed balance to hold in such an equilibrium state, hence the dynamics are 
conservative: A, J s = 0. Under these circumstances, we get 

Y = R = f3^JdtX^--AF^= p\V diss , (53) 

where AF = F(B) — F(A), and W d i SS = W — AF is physically interpreted as dissipated 
work (7J. There is no distinction between Eqs. 031 and |^ in this situation; both are equivalent 
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to the Crooks fluctuation theorem [ljj], and the corresponding integrated result (Eq. 
below) is the nonequilibrium work theorem, 

(e"^> = e~ 0AF . (54) 

When A ^ 0, the dynamics are non-conservative. To gain insight into the physical 
meaning of the vector field A, consider an overdamped, one- dimensional Brownian particle 
at temperature T, with periodic boundary conditions (see e.g. Figure 1 of Ref. |2f|): 

dU 

7* = -^+/ + C(*), ( 55 ) 

where 7 > and / are constants; U{x\ A) is a periodic potential; and the noise term satisfies 
(£(0)£(t)) = 2^y k bT 5 (t). When A is held fixed the system relaxes to p s = e~ v . Comparing 
with Eq. EJ and using the definition of A (which for this example is a scalar field), we obtain 

A = (3(-U' + /) + </, (56) 

where the primes denote dl dx. In previous studies of this example by Hatano and Sasa ^| 
and Speck and Seifert |2l| . the quantity Qhk = / dx A was identified as the "house- 
keeping heat", a concept introduced earlier by Oono and Paniconi [34]. In the stationary 
state, Qhk represents the heat absorbed by the external reservoir; this fluctuating quan- 
tity grows linearly with time, on average, and can be viewed as the thermodynamic price 
that must continually be paid to maintain the system away from equilibrium. Equivalently, 
(3Qhk = J dx A is the increase in the entropy of the reservoir. We speculate that this inter- 
pretation remains valid more generally: when Eq. El models a system in contact with thermal 
surroundings, perhaps including multiple heat baths, J dx ■ A is the entropy generated in 
these surroundings, in the stationary state. This interpretation emphasizes the physical 
connection between entropy generation and the violation of detailed balance. 

We see that Y can be interpreted as dissipated work (in units of kgT) when the dynamics 
are conservative, and J dx ■ A as the entropy generation needed to maintain a nonequilib- 
rium stationary state. For the non-autonomous, non-conservative case, we do not have 
simple thermodynamic interpretations of Y and R. However, we can provide some intuition 
regarding the difference between these quantities by considering a quasi-static process, with 
A varied slowly from A to B. Then Y — > Q|, whereas J dx ■ A can be expected to grow 



13 



diffusively, with slowly changing drift and diffusion constants. Hence as r — > oo, the distri- 
bution of Y values tends to a delta-function, while the mean and variance of the distribution 
of R values scale like r. 

Finally, let us briefly consider a generalization of Eq. 031 The quantity Atp appearing 
in Eq. EH] is essentially a boundary term Q], arising from the ratio of the probabilities 
of sampling the initial conditions of the conjugate pair of trajectories, X and X' . If we 
choose to sample initial conditions from distributions other than the stationary distribution, 
p s , then this term must correspondingly be modified. Specifically, consider a family of 
normalized distributions q\(x) = exp[— if)(x; A)], where ip{x; ^) is arbitrary (apart from the 
normalization condition). Now imagine that we define our forward (reverse) process by 
sampling the initial conditions from {qs) rather than p s A {p s B ). The boundary term in 
Eq. EH! then changes from Aip to Aip, which ultimately leads to the result 

p F (+i^) 



where 



exp(i^), (57) 



R^ F = I dtk F ^- + (* dx-A* , A^ = v + Vif), (58) 



and similarly for the reverse process. Eq. |33 thus generalizes Eq. 03] to allow for initial 
conditions sampled from arbitrary distributions. 

As a specific example, suppose there exists a natural decomposition (3v = — V£7 + /, 
where / cannot be expressed as the gradient of a scalar field, e.g. imagine a Brownian particle 
exploring a potential landscape U(x; A), but also subject to a non-conservative force f(x; A). 
This is a generalization of the one-dimensional example discussed above (Eq. 155)) . Now 
suppose we sample initial conditions from the canonical distribution q oc exp(—/3U), rather 
than the stationary distribution p s = exp(— if). This corresponds to the choice if) = f3U, 
where for simplicity we have incorporated the free energy F(X) into the definition of U (x; A). 
The quantity R^ appearing in Eq. then becomes 

R^ F =p dt\ ¥ t ^- + (3 dx-f. (59) 



d\ 

We thus get a fluctuation theorem for a quantity R^ that is physically interpreted as the 
sum of contributions due the external variation of a conservative potential, U, and the path 
integral of a non-conservative force, /. Neither term depends on the stationary distribution 
if. This result was originally obtained by Kurchan, first for autonomous dynamics jj| = 

14 



(3 J dx ■ /), and more recently for non-autonomous dynamics assuming a spatially 
independent diffusion coefficient. 



VII. ILLUSTRATIVE EXAMPLE 

In this Section we illustrate the fluctuation theorems derived above, using the example 
introduced at the end of Section |TT1 We begin with the autonomous case. If f(q) = 0, then 
we simply have a Brownian particle fluctuating in equilibrium in a two-dimensional harmonic 
well. When f(q) > 0, the particle is subject to an additional angular drift, oriented counter- 
clockwise. Let us picture this drift to be the result of a vortex in the surrounding thermal 
medium, centered at r\. In this case the integral 

J dx-A= fdtrt -df(q t ) = C[X\ (60) 

provides a measure of the counterclockwise motion of the particle. We will refer to C as 
the circulation associated with a given trajectory X. Since we are considering autonomous 
dynamics, we have R = C (see Eq. IHTjl . and Eq. becomes 

£g = «p(C). (61) 

Here p(C) is the probability distribution of observing a circulation C, over the interval of 
observation, assuming initial conditions sampled from the stationary distribution (Eq. I17|) . 
Since A is fixed, there is no distinction between the forward and reverse process. Eq. |^ 
implies that positive values of circulation are more likely than negative values, as expected: 
the particle tends to flow with, rather than against, the vortex. 

Now consider the case of non-autonomous dynamics, but conservative forces, f(q) = 0. 
For specificity, imagine that during the forward process we vary A at a constant rate from 
A to B, e.g. we move the point r\ rightward along the a?-axis. Thus we drag the Brownian 
particle through a thermal medium, by moving the harmonic potential in which it is trapped. 
During the reverse process we go from B back to A, at the same speed. Since the forces are 
conservative (A, J s = 0, hence C\ = £\), there is no distinction between the predictions of 
Section HVl and those of Section moreover there is no tendency for the particle to circulate 
in one direction or the other. We have 

R = Y ee J dt\^- = -k j d\(x t - X t ), (62) 
15 



where Xt is the x-component of the particle's position at time t. Physically, — k(x — A) dX is 
the incremental work required to displace the potential well by an amount dX, hence Y is 
equal to the total external work performed during a realization of either the forward or the 
reverse process (in units of temperature, since k^T = 1 for this example). Eqs. l4"31 and I5T1 
are identical in this situation, and are expressed as 



Positive values of work are more likely than negative values, in agreement with the second 
law of thermodynamics. 

Having obtained one prediction for the case of autonomous dynamics and non- 
conservative forces (Eq. |M]for C), and another for conservative forces and non-autonomous 
dynamics (Eq. E21 for Y) > we now consider the combination of non-autonomous dynamics 
and non- conservative forces. Thus r\ now specifies the moving center of both a harmonic 
well and a vortex in the thermal medium. Let C\ denote the stochastic dynamics for a 
given choice f(q) > 0, describing a counter-clockwise vortex; then C\ corresponds to the 
replacement / — > —f, describing a clockwise vortex. 

If we use £\ for both the forward and the reverse processes (Eqs. |^ l%4"j) . then this 
amounts to dragging the particle either rightward (A — > B) or leftward (B — > A), but in 
either case the particle tends to circulate counter-clockwise around the moving point r\. The 
fluctuation theorem in this situation, Eq. 021 involves the quantity R = Y + C, with external 
work Y and circulation C as defined by Eqs. IH21 and above. On the other hand, if we use 
C\ for the reverse process (Eq. 145)1. then the particle tends to circulate counter-clockwise as 
it is dragged rightward during the forward process, but clockwise as it is dragged leftward 
during the reverse process. In this case the applicable fluctuation theorem is Eq. |^for the 
work Y; the circulation C no longer contributes to the quantity appearing in the fluctuation 
theorem. 



P F (+Y) 



exp(Y). 



(63) 
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VIII. INTEGRATED FLUCTUATION THEOREMS AND FURTHER EXTEN- 
SIONS 



Multiplying both sides of Eq. E2]by p R (— R) exp(— R), then integrating with respect to 
R, and performing similar manipulations on Eq. EH we are led to the integrated results, 

(exp(-i?)) F = 1 , (exp(-F)) F = 1, (64) 

where the angular brackets denote an average over realizations of the forward process. For 
the general case of non-autonomous and non-conservative dynamics, with initial conditions 
sampled from the stationary state, these results have been discussed by Hatano and Sasa [l^ 
(for Y), and by Speck and Seifert [2]] (for R). Unlike Eqs. E3] and El the integrated fluctu- 
ation theorems can be stated without any reference to the reverse process, suggesting that 
they can be derived by some means other than a comparison between forward and reverse 
processes. We now sketch such a derivation, which in turn leads to a further generalization 
of both integrated and non- integrated results (Eqs. I7UII7T|) . 
We assume our system obeys the equation of motion 

— Xi = Fi(x; A t ) +£i(t;x; A*), (65) 

where At denotes a protocol for varying the parameter A. For a trajectory generated during 
this process, consider the variable 



Ld t = dt' 



A^ + a x ■ A + -a(at - l)G ij A i A j 



(66) 



where a is a constant, and the integrand is evaluated along the trajectory. For a = and 
1, we get oj t = W and R, respectively. 
Now consider a function 

Q(x,t) = (^5(x- x t ) exp(-o; t )V (67) 

where the average is taken over an ensemble of realizations of the process, and x t is the 
microstate at time t during a given realization This function can be viewed as a "weighted" 
phase space density, in which each realization carries a time-dependent statistical weight 
exp(— u t ); similar constructions have been considered in Refs. P, 13, 13, Q Following a 
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procedure analogous to the derivation of Eq. |U in the Appendix, we obtain an evolution 
equation for this density: 

^-g = c x g - + a d l {G VJ A>g) . (68) 

The first term on the right represents the dynamical component of the evolution (Eq. 0J), 
while the other two arise from the weight exp(— uo t ) assigned to each trajectory in the ensem- 
ble. Using Eqs. IB! fTUl andlTTl we see by inspection that the ansatz g(x,t) = exp[— <p(x; X t )) 
solves Eq. EH1 Thus when initial conditions are sampled from the stationary distribution 

p (x; X- T ), we have 



S(x - x t ) exp(-u t )) = exp [-ip(x; X t )} . (69) 

Setting t = +t and integrating both sides with respect to we get 

(exp(-u T )) = 1. (70) 

This represents a family of predictions - parametrized by the value of a - that are all satisfied 
for the same process, Eq. 121 For the choices a = 1, 0, Eq. [TU] reduces to EqIMl 

Since Eq. ITOl generalizes Eq. EH to arbitrary a, it is natural to search for a corresponding 
extension of Eqs. ESI and EU Such a result indeed exists, and is given by: 

— = expK). (71) 

Pa(-^r) 

Here p F and denote ensemble distributions of uj t for a forward and a reverse process. 
The forward process is defined as earlier, for the protocol Af and a family of Fokker-Planck 
operators C\ <-> {J s , ip, G}. The reverse process uses Af and 

£;<-{jf, (72) 



where = (2a — 1)J S . The derivation of Eq. [7T] follows the same steps as in Sections ITVl 
and starting from a generalization of Eqs. US and 



S + - SI = Xi (<9V - aA { ) - l -a(a - \)G l3 A l A\ (73) 

with S°_ defined for as 5_ and 5_ were defined for C\ and C\. For a = 1, we get = 
±J 5 , and Eq. EU reduces to the fluctuation theorems derived earlier (Eqs. IHTjl . Further 
generalizations are relatively obvious - for instance, replacing Eq. [721 by {K, <p, G}, 

where K(x;X) is an arbitrary divergenceless vector field - and will not be pursued here. 
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IX. DISCUSSIONS AND CONCLUSIONS 



There has been considerable recent interest in understanding fluctuation theorems within 



a Langevin framework 



0,Q 



22, 



35 



36 



37 



0, 3, Q- 



This interest has been moti- 



vated in part by experiments involving systems that are naturally modeled using Langevin 
dynamics, such as externally manipulated biomolecule s |4ll . |42], optically trapped col- 



loids 



43, 



44 



45 



46 



471 ]. or a torsional pendulum 



In the present paper, using 



the path-integral framework, we have emphasized the separate contributions of two distinct 
sources of nonequilibrium behavior: non-conservative forces and non-autonomous dynamics. 

We conclude with a specific physical example where the exact relations discussed above 
apply. Consider a macromolecule, such as a polymer, that is subject to thermal noise and 
is manipulated externally (for instance using optical tweezers or atomic-force microscopy) 
on a time scale comparable to its relaxation scale. If such an experiment is carried out with 
the molecule immersed in a stationary, equilibrium solution, then we have the situation 
of conservative forces and non-autonomous dynamics. As pointed out by Hummer and 
Szabo [l| and subsequently verified in Refs. j^l], 42], such experiments can be used to 
reconstruct the free energy landscape of the macromolecule. 

We can imagine broadening the scope of these investigations to include non-conservative 



forces, for instance by manipulating a molecule subject to shear |5Jj,|5l( and/or chaotic 



52, 



531 ] flows. If such flows are accurately modeled as Markovian noise - that is, if the correlations 



of the flow decay on a time scale that is very short in comparison with the relaxation time of 
the macromolecule - then the results we have derived in this paper ought to apply directly. 
When the shear or chaotic flows are non-Markovian, then a suitable modification of our 
formalism would be needed. A natural starting point for such a modification is the recent 
progress achieved in the understanding of polymer stretching and particle separation in 
chaotic flows 0, Q • 

The feasibility of any realistic experiment along these lines will be constrained by certain 
general considerations. While the theoretical predictions are expressed in terms of infinitely 
many realizations, in a real experiment the number of measurements is necessarily finite. 
At the same time, if the parameter A is varied rapidly, then averages such as those in 
Eq. |^ might be dominated by realizations that are extremely atypical. The faster the 
protocol for varying A, the more realizations we are likely to need. This introduces an 
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important consideration when choosing a protocol for externally manipulating the system. 
Furthermore, in experiments with complex molecules we inevitably have access to only a 
small fraction of the system's degrees of freedom, such as its end-to-end extension. Thus we 
must design an experimental setup in which the quantities that we want to measure (Y, R) 
can be determined uniquely from the data to which we have access. This might significantly 
limit the scope of the predictions that we could hope to test. 
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APPENDIX A: DISCRETIZATION SCHEME 

A stochastic differential equation such as Eq. |2] remains ambiguous until we specify the 
limiting procedure associated with the discretization of time (A — ► 0). In this Appendix 
we describe the discretization scheme that we adopt in this paper, and we sketch the steps 
then taken to derive Eq. 0J To avoid a proliferation of vector and tensor indices, we restrict 
ourselves to the one-dimensional case. 

We imagine that the time interval [— r, r] is cut into K ^> 1 equal segments of duration 
A, delimited by the sequence {tcb^i; ' ' ' ^k}, where t = — r, tjc = t, and t k+ \ — ijt = A. 
The evolution of the dynamical variable x(t) and external parameter X(t) are represented 
by a discrete sequence: (x(t),X(t)) —> (x(t k ), \(t k )) = (x k ,X k ). The conditional probability 
of the trajectory X = {x , ■ ■ ■ , xk} is given by a product of transition rates: 

V x [X\x ]=l[W k (x k+1 ,x k ), (Al) 



A- 



W k (x k+1 , x k ) = h(x k ) exp 



A {^-F(x k )) 2 T(x k ) 



(A2) 



2 VA 

where x k = (x k + x k+ i)/2, e k = x k+ i — x k , and primes denote derivatives. The prefactor n 
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is given by the function 



n[x) 



r(x) 

2ttA 



A 



T'(x) 2 



V"{x) 



which guarantees normalization to first order in A: 



J dx k+1 W k (x k+1 , x k ) = 1 + 0(A 2 ). 



(A3) 



(A4) 



In the limit A — > 0, Eqs. IA1I - IA3I define the Markov process that we have denoted by Eq. |21 
Our task is now to derive the master equation associated with this Markov process. 

Eq. IA2I uses a mid-point regularization scheme not only for the functions F(x) and T(x) 
inside the exponent, but also for the prefactor n(x). Let us rewrite this prefactor, 

A 



nix) = nix) 1 



-F' 



n [x e 



-AF'/2 



(A5) 



and incorporate the factor e AF '/ 2 inside the exponent in Eq. IA21 Thus, to first order in A, 



W k (x k+1 ,x k ) = n(x k ) exp 



~(^-F(x k )) 2 r(x k )-^F'(x k ) 



(A6) 



with n(x) as defined by Eqs. E2 El This expression, combined with Eq. IA1[ specifies the 
sense in which Eq. [TH] is interpreted, with Af = Yik=o n (^k)- Note that jV[X] = A/"[A^] 
(because we use the mid-point rule), and Af does not depend on the function F(x). These 
properties lead to the cancellation of normalization factors in Eqs. 021 and UHl respectively. 
To arrive at Eq. 01 we must evaluate 



Pk+i{x)= / dx'W k {x,x')p k (x')= / deW k (x,x - e)p k (x - e) 



(A7) 



where p k , p k +i denotes the probability distribution at time t k , t k+ i. Substituting Eq. IA6 
into Eq. IA7[ and changing the variable of integration from e to 



£(x) 
A 



we get 



Pk+iyx) 



J dz exp (--jj Pk{x) H(x, z, y/K). 



(A8) 



(A9) 



We will not give the explicit, cumbersome expression for the function H defined by this 
procedure, but we note that liniA^o H{x, z, VA) = 1. Thus we have factored out the 
dominant Gaussian contribution to the integrand in Eq. lA7l leaving a slowly varying function 
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of z. Expanding H in powers of y/A, to 0(A), and evaluating the resulting Gaussian 
integrals (of the form J dz e~ z2 ^ 2 z m ), we eventually obtain 

Pk+l = Pk - A (F'p k + Fp' k + ^p' k - ^p'^j , (AlO) 

where the p's, F, and T, and their derivatives, are all evaluated at x. In the limit A — > 0, 
this becomes Eq. HJ 

We emphasize that with a different choice of discretization - for instance, if we had used 
a prefactor that is a function of Xk rather than the mid-point Xk - we would have obtained 
a different Fokker- Planck equation. 
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